About

Samuel Hsin-Sheng Duan is a Senior Data Engineer at JobTarget with over 6 years of experience in turning data into value across multiple industries, including digital advertising, financial services, real estate, manufacturing, online education, and solar energy. He is a thought leader, self-sufficient, and capable of building data solutions across the whole stack from ingestion to service and insights. Samuel has hands-on experience with Python, Spark, Scala, SQL, C++, MATLAB, data/ML engineering, data pipeline, data warehouse, data modeling, ML model deployment, big data/devop tools such as Airflow, Databricks Spark, AWS, GCP, Snowflake, and Azure. He is also skilled in microservices, RESTful API development, marketing analytics, digital marketing, audience targeting, text/image classification using deep learning and NLP. Currently, Samuel is a Senior Data Engineer at JobTarget, where he has developed and deployed ML solutions on AWS for all aspects of job advertising, including bid management, customer churn propensity, and product recommendation. Previously, he worked at Slalom as a Data Architect and Consultant, where he led a team of consultants to create a modern analytics platform on AWS. He also built and maintained a data pipeline that processes and transforms 100+ GBs of advertising data per day using Python, SQL, Airflow, Teradata, AWS Step Functions, and provided thought leadership to 7 team members on the best practices in Airflow orchestration, CI/CD, Git strategy, and testing. Samuel has also worked as a Lead Data Engineer at EasyKnock, where he led all data science and engineering initiatives, including the development of ETL pipelines and data warehouse using Airflow, Python, Scala, SQL, Databricks Spark, Redshift, and BigQuery. He also designed and prototyped an end-to-end scalable machine learning pipeline for real-time customer qualification, consisting of automated data extraction, model deployment, and model workflow management using Segment, Databricks Spark, MLflow, Python, Sagemaker, S3, RDS, Redshift. Samuel holds a Doctor of Philosophy degree in Materials Science and Engineering from the University of California, Los Angeles, and a Bachelor of Science degree in Electrical Engineering from National Taiwan University. He is also skilled in Data Engineering, ML, AWS, SQL, Apache Airflow, Databricks, Spark, Snowflake, Python, Data Warehouse, Microservices